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ABSTRACT 



The purposes of this study were to describe the validation of a new instrument, the Teacher 
Communication Behavior Questionnaire (TCBQ), and its use in assessing students' 
perceptions of their interactions with their teacher by focussing on their teachers’ 
communicating behaviors. The study described in this paper occurred in secondary science 
classrooms in Taiwan. Quantitative and qualitative approaches were used in the 
development and validation process of the TCBQ. The questionnaire was then used to 

l ^Z^J?T 1CSe SeC !f dary SCiCnCe tCacherS ’ behav «>rs, and their associations with 
students perceptions amtudes toward science and science academic achievement Results 

shows that all five scales of the TCBQ were found to display satisfactory internal 
consistency reliability, discriminant validity, and factor validity. There were strong 
associations between the scales of the instrument and students’ altitudes to science and two 

5 ?? ^ ” WCrC associated ^ c °gniti v e achievement This instrument has added an 
additional aspect to research on teacher-student interactions by focusing on the use of 

Pr °T 0tC students ’ creadve ability and the use of verbal 

and non-verbal feedback to enhance students’ attitude toward science and their academic 
achievement outcomes. tmc . 

THEORETICAL BACKGROUND 

C0Qfinned “POMBt contribution made by teachers in creating a 
classroom environment or atmosphere conducive for science learning. In particular 
teachers make a major contribution towards creating a positive learning environment in 
science classes through their interaction or communication with students (Wubbels & Levy 

Br0phy 311(1 EvertS0Q ( l98I > found that teachers’ affective reactions to students’ 

( _ hment, concern, indifference, rejection) influenced their behavior toward them 

rZL S ^ (I980) StU ^! d 87 SCCOndary classrooi ns and reported that teachers 
P00r ^ UCVement students used more class time for non-interactive 

g ^ dC l paperS 0r made lesson P Ians w ^e their smdents worked on written 

^ *** “ WhiCh 3 t “ chcr ‘s not only a 

predictor of student achievement, but also is related to such factors as teacher Lh 

teacher h| burnouL Appropriate teacher-student interactions are important to 
pre ent discipline problems and to foster professional development fFisher Fracer a, 
C^wlI lW; wubbels 4 Levy. 1993). Student EStaS? ETtai 
own to be particularly important m a "constructivist" classroom, where emotion plays a 

mQrC promm ent "*.(»« * Bentley, 1987). Other research hi indica^taJoXe 

interacnons and relationships between teachers and students promote student incerest and 
outcomes in science (Wubbels* Levy. 1993). suiuent mterest and 

Classroom interactions occur rapidly in a classroom and teachers are usually not aware or 
ab e to describe or remember what happens in cheir interactions with students For 
example. Good and Brophy (1974) interviewed teachers and confirmed that trach ° 
usially were not aware how many questions they asked students and what kind of feedback 

ml/Zff T r f hdp .“ aChm id “ dfy their fractions in teaching and 
make them aware of what happens m class, it is difficult to promote positive science 



classroom interactions. Therefore, the authors decided to develop a questionnaire which 
focused on aspects of teacher-student interactions in the secondary science classrooms. 

It is possible to ask teachers for their perceptions of their classrooms, however these 
usually differ in some respects from those of students (Cooper & Good, 1983; Fraser, 
1998; Wubbels & Levy, 1993). In this study, it was decided to focus on student 
perceptions. Therefore, the purpose of this study was to establish a questionnaire which 
would allow a study of student perceptions of teacher behavior in a large number of science 
classes at the same time. In the longer term, it is hoped to develop a better understanding of 
teacher behavior occurring in science classrooms in both Taiwan and Australia. 

Two major resources were utilized in the development of this new questionnaire. The 
Dutch researchers (Wubbels, Creton. & Holvast, 1988; Wubbels, Creton, & Hoomayers, 
1992; Wubbels & Levy, 1993) investigated teacher interpersonal behavior in a classroom 
from a systems perspective, *Hap rin g a theory on communications processes developed by 
Waltzlawick, Beavin, and Jackson (1967). Within the systems perspective of 
communication, it is assumed that the behaviors of participants mutually influence each 
other. The behavior of the teacher is influenced by the behavior of the students and in turn 
influences the student behavior. Thus, a circular communication process develops. This 
'systems approach' assumes thar one cannot communicate when in the presence of 
someone else. Based on this systems approach, the Questionnaire on Teacher Interaction 
(QTI) (Wubbels <fc Levy, 1993) was developed. The items of the QTI and the literature 
describing its previous use were an important source of information when developing a new 
questionnaire for use in secondary science classrooms teacher-students interaction. 

Previous teacher-student interaction work by one of the authors was used as the other 
source of information (She, 1997, 1998; She & Barrow, 1997). This' systematic classroom 
observation research involved the use of questioning and verbal and non-verbal 
reinforcement in the teachers' interactions with students. Past research studies have shown 
these two interactive behaviors have had a considerable effect on students' achievement 
(e.g.. Good & Brophy, 1974, 1991; Walberg, 1984). According to these teacher-student 
interaction studies, questioning is the key factor in the interactions that occur between 
teachers and their students. Questions have been shown to be an important and integral part 
of learning, and questions asked by teachers can become indices of the quality teaching 
(Carlsen, 1991; Smith. Blakeslee, & Anderson. 1993). Deal and Sterling (1997) suggested 
that effective classroom questions promote relevance, encourage ownership, help students 
interpret their observations, and link new learning to what students already know. Thus, 
the scales and items of our new questionnaire also were based upon this previous work on 
classroom teacher-student interaction, particularly, the work of She (1997, 1998). 

The result was the development of the Teacher Communication Behavior Questionnaire 
(TCBQ) containing five scales: Challenging Questioning (CQ), Encouraging and Praising 
(EP). Supporting Non-verbally (NV), Understanding and Friendly (UF) and Controlling 
(CO). The initial version of the TCBQ contained 60 items altogether, with 12 items 
belonging to each of the five scales. The set of items passed through several successive 
revisions including reactions solicited from students about the readability and 
comprehensibility of items and whether they were responding to the items on the basis 
intended by the developers. This led to some modifications to questionnaire items. Table l 
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each sZle. deSCnpt,0n of the meaning of each of the five scales 



and a sample item from 



Table l 

of Secies a „ d aSa „ ple hem for Each Seal, 
Scute Name 



Challenging Question! 



e of the TCBO 

Description of Scale 



Encouraging and Praising 



Supporting Non- Verbally 



Understanding and Friendly 



Controlling 



higher-order questions co 

challenge students in their 
learning 

Extent to which the teacher 
praises and encourages students 

detent » which the teacher uses 
non-verbal communication to 
interact positively with students. 

wfcich the ceacfwr is 

understanding and friendly 
cowards the students 



Sample Item 



This teacher asks , uestions 

r h “ re ’ u,re ™“wlywh K 

1 have Earned in class ir 
to answer. 



<n order 



This teacher praises me for 
asking a good question. 

This teacher smiles at me to 
show support while [ anr 
frying to solve a problem. 

This teacher understands 
when I doubt something. 



Accent to which the teacher 
controls and manages student 
behavior i n the classroom 



This teacher requires us to be 
quiet m his/her class. 



ITT " 1 

between these hools science classrooms in r, communication 

achievement. 0nS 311(1 * e Cents’ attitudes toward icieroHLiA aSS ° Ciarions 

METHOD 

» «— *. :o 

^tors.mccu re of t he n rCB<^‘ d ‘‘ y ' a"pran 



o 
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(a order to determine the practical viability of the TCBQ scales with students, we examined 
what perceptions students had of the scales and the items. How did they interpret each 
scale? What did they think an item meant? Were the students viewing the concepts behind 
each scale in a similar manner to the original developers? This was particularly important 
as the quantitative analyses of data suggested that in some classes a diverse range of 
students’ views existed. A semi-structured interview was used during which students first 
were asked to comment generally about the nature of their science class. The questions 
then focused on the teacher’s use of challenging questions, praise and encouragement, non- 
verbal support, understanding and friendly behavior, and controlling behavior, i.e., the 
scales which were assessed in the TCBQ. We then referred to student responses to various 
items to see if the scales were actually assessing what they were supposed to be assessing. 
Schools to be involved in the interview component of the study were selected according to 
the students’ responses to the questionnaire and 50 students were interviewed for a 
minimum 15 minutes. 

The TCBQ was then used in an application to determine whether there were any 
associations with student outcomes. To obtain some outcome measures, 836 of the students 
in the sample responded to four a tt i tu de scales from the Test of Science Related Attitudes 
(TOSRA) (Fraser, 1981). These scales were Social Implications of Science, Enjoyment of 
Science Lessons, Leisure Interest in Science, and Career Interest in Science. To provide a 
measure of cognitive achievement the end of semester results of 242 of the students were 
obtained. Simple and multiple correlation analyses were used to determine whether there 
were any associations between students’ perceptions of their teachers’ behaviors and their 
attitude to class and cognitive achievement. 

VALIDATION OF THE TCBQ 

The first step in the modification and validation of the TCBQ involved a series of factor 
analyses to examine further the internal structure of the set of 57 items which had survived 
the item analyses. Principal components analysis with varimax rotation was used to 
generate orthogonal factors. These fee tor analyses led to a decision to delete 17 i tems , 
either because they were loaded on more than one factor, or their loading was lower than 
0.3 1. The 40-item five-factor instrument shown in Table 2 was decided upon as the optimal 
structure for the fin a l version of the TCBQ. Every one of the 40 items in the final version is 
retained in exactly the same scale to which it was assigned when the instrument was 
originally developed. Apart from the deletion of certain items, the factor analyses have 
confirmed the validity of the original structure of the questionnaire without the need to 
change the scale allocation of any item or the name of any scale. Taken together, ail of this 
evidence lends considerable support to the a priori factor structure of the 40-item, five- 
scale version of the TCBQ. 
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Table 2 




All loadings smaller than J have been omitted. 
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Analysis of responses to the TCBQ using the individual student as the unit of analysis 
revealed that each scale had very good internal consistency, with alpha coefficients ranging 
from 0.86 to 0.93 with the individual student as the unit of analysis. Another feature 
considered important in a classroom environment instrument is the discriminant validity of 
each scale of the instrument, that is, the extent to which the scale measures a dimension 
different from that measured by any other scale, la this study, the mean correlations of one 
scale with the other four scales ranged from 0.16 to 0.50. These values can be regarded as 
small enough to confirm the discriminant validity of the TCBQ, indicating that each scale 
measures a distinct, although somewhat overlapping, aspect of the teacher’s 
communication behavior. 

Also, the ability of a classroom environment instrument to differentiate between classes is 
important. Students within a class usually view the classroom learning environment 
similarly, but differently from students in other classes. The instrument's ability to 
differentiate in this way was measured using one-way analysis of variance (ANOVA) with 
class membership as the main effect. The results, depicted in Table 3, show that each of 
the scales did in fact significantly differentiate between classes O<0.00i). The amount of 

variance explained by class membership is reflected in the eta* scores which ranged from 
0.17 to 0.22.. * 

Table 3 

Internal Consistency (Cronbach Alpha Coefficient) Discriminant Va lidi ty (Mean 
Correlation with other Scales) and Ability to Differentiate Between Classrooms for 
the TCBO J 



Scale 


Alpha 

Reliability 


Mean Correlation with 
Other Scales 


ANOVa Results 
(eta 1 ) 


Challenging 

Questioning 


0.38 


0.40 


0.17** 


Encouraging <i 
Praising 


0.90 


0.50 


0.19** 


Supporting Non- 
verbally 


0.93 


0.50 


0-ZI" 


Understanding & 
Friendly 


0.91 


0.46 


0.22** 


Controlling 


0.36 


0.16 


0.21** 



it- 1 202 >c 0.00 1 



CVTERVEW RESULTS 

The interview data assisted us with the validation of the instrument and our understanding 
of the teachers* communication behaviours in secondary science classrooms in Taiwan. 
Fifty students were interviewed for a maximum of 15 minutes. Initially, students were 
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asked whether they could tell us what the questionnaire was about 
comments were these two: 



Among typical student 



“* ‘ each€r! meth °* w ,k ° r* 

Yes, it was about the teacher and how she teaches. 

From the above and other questions that were asked, it was clear to rh» u 
smdene were able to read the TCBQ and bad some Mea what it was atout “ 

The questions then became more focused and we referred to student 

items to see tf the scales were actually assessing whar eh- dent res P onses ^ various 

?•„ were also seeing questio^”^ T”* " h * ““““'S' 

fear ^ romm “ o s ~ 4e — zssz&z of™: 

Challenging Questio ning 

Does your teacher ask questions very often? 

Yes. the teacher asks a lot of questions. 

What types of questions does your re^chn* ask? 

Th, T?T w kite. 

T™ K ‘*her likes to askus. "Why would it hannen*" t 

The teacher rarely asks us yes Zoo wesdZ ' **"""* 

wiry did you circle always or very often to these items'’ 

Because the teacher always asks a lot of questions to all of us. 

Could you tell me why you circled 4 for number S’ 

• ^ 
continue to answer the teacher's Questions * 

Encouraging and Praisin® 

How does your teruther respond wheo you aoswer a question’ 
wr// joy" q & veo , H C5Uon ‘ 

o/fe* the teacher will clarify mv ideas . 

^t^tt^usreorf of praising my answer or using my tteughts 'as panZ 

* e ““ her prais “ my «* the teacher uses my 

Does your teacher encourage you to answer questions? 

Yes. the teacher usually will ask students who know the , 

their hands to answer the questions. " raise 

Does the teacher give you hints if you do not know how to answer the 



she « ill help you to think of on answer 
Supporting Non Verbally 

Does your teacher use some other ways to help you answer questions? 

The teacher usually will nod her head or smile to us. 

shows his/her enthusiasm about my quesdons 

"“t you are talking, the teacher will show her 

enthusiasm through her eyes or face to show that she ts expecting a go 

question. 

Another student who circled 2 for this item said 
Because l seldom ask the teacher questions. 



Understanding and Friendly 



Is vour teacher friendly to you? 

Yes. she is very friendly to us. She usually will not get angry unless we are 

too noisy. 

(27. If t have something to say, this tea c he r will listen.) 

Why did you circle 5? _ , , , 

for instance, we went to Motional Science Museum and the teacher 

listened to our talking while on the bus. 



(29. This teacher is patient with me.) 

Why did you circle 4? . , 

Because this teacher is patient. If you have something you do not 

understand, the teacher will explain to you more than three times until 
you understand. 



Controlling 

Does your teacher have any expectations of you? 

Yes. the teacher asks us to bring our books and other things to the class. 

Do you think the expectation are too high for you? 

Mo. / do not think so. She just likes to ask us to study hard. 

Why did you circle 4 for this item? 

(34. This teacher expects me to obey his/her instructions.) 

You must follow the teacher s instructions during the laboratory or the 

teacher might be unhappy. 



Another student who circled 5 said 
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H STUDENT OUTCOMES 
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doth shnpfe ^ mu tepfe^S ttv * “dicveme,,, outc^T-l*” 1 ' *****' dehavi or 
for che atdtudinoi andcnJ?-^ a ^yses. Tabies 4 Jn w *’ * ^ We re analyzed „«• 
describes the bivariate asS^* ° Urcomes ’ aspect iveiy. results separate 1 y 

«** w ^ »^ S o' r ,e 

table 4 controlled. a particular 

Associations between TCBn , 

=====Llt^!t^ — — ~ 






me Association 



Scale 



Social 



bv £Z"* *te* 




'V < 0.001 



V< 0 . 0 l 



N ™ 409 



o 
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• t . i a r h a r four of the TCBQ scales: Challenging Questioning, 

The results m a e Non- verbally, and Understanding and Friendly were 

Encouraging and scale* however, a weaker correlation existed 

Z n t L four scales of the TCBQ have a great effect on 

the students' attitude toward their science lessons. 

The multiple correlation (*) data repotted in Table 4 indicate that associations were 
Son£m between students' perceptions of the first three scales assessmg teacher 
communicating behavior and attirudinal outcomes. In classes where the students percetved 
moTien^ng questions, received mote encouragement and praise and received non- 
"rtai mppoh Item their teachers, there was a more favorable attitude toward the science 

class. 

AS de picted in Table 5. the students' academic achievement outcome was significantly 
correlated with two scales of the TCBQ: Challenging Questioning and Understanding and 
Friendly. The multiple regression analysis indicates that Challenging Questioning was the 
scale most strongly associated with the cognitive achievement outcome when other TCBQ 
scales were mutually controlled. 



^sociations Between TCBQ Scales and Students ' Cognitive Achievement Outcome in 
Terms of Simple Correlations (r) and Standardized Regression Coefficient (b). 



Scale 


Strength of TCBQ Scale 


- Outcome Associadon 




r 


b 


Challenging Questioning 


0.33** 


0.37** 


Encouraging 8c Praising 


0.12 


-0.12 


Supporting Non-Verbally 


0.14 


-0.0 1 


Understanding 8c Friendly 


0.19* 


0.10 


Controlling 


-0.06 


-0.13 


Multiple Correlation, R and £ 2 




0.36** and 0.14** 



**p <0.001. *p<0.0l a= * 242 



CONCLUSIONS 



This study has confirmed the reliability and validity of the TCBQ when used in Taiwan 
science classrooms. Thus the instrument can be used by science teachers and researchers in 
Taiwan to improve science teaching and student achievement. The study used a 
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